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NOTE:  The  findings  in  this  report  are  not  to  be  construed  as  an  official  Department  of  the 
Army  position,  unless  so  designated  by  other  authorized  documents. 


BESRL  Technical  Research  Reports  and  Technical  Research  Notes  are  intended  foi 
sponsors  of  R&D  tasks  and  other  research  and  military  agencies.  Any  findings 
readv  ft,'  implementation  at  the  time  of  publication  are  presented  in  the  latter  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recommenda¬ 
tions  for  official  action  normally  are  conveyed  to  appropriate  military  agencies 
by  briefing  or  Disposition  Form. 


FOREWORD 


The  mission  of  the  OFFICER  PREDICTION  Work  Unit  is  to  develop  improvec  sans  of 
assigning  officers  who  have  aptitudes  and  other  characteristics  to  meet  the  differing 
demands  of  different  officer  activities. 

The  research  program  consists  of  the  development  of  psychological  tests  and  tech¬ 
niques  and  the  evaluation  of  the  measures  as  differential  predictors  of  performance  in 
combat,  technical,  and  administrative  duties.  In  1958  and  again  ...  1962,  experimental 
tests  for  the  Different  Battery  v.crc-  ini  stared  to  Regular  Army  and  Reserve 

officers  entering  on  active  duty,  numbering  more  than  10,000.  The  experimental  piedictors 
are  being  evaluated  as  predictors  of  success  as  measured  by  several  methods.  Ratings  by 
superiors  and  peers  were  accomplished  after  about  one  year  of  active  duty.  In  1964  i 
1965,  a  series  of  situational  tests  in  which  the  officer  is  confronted  with  problems  typical 
of  service  under  comtat  conditions  in  each  of  the  three  areas  was  administered  to  900 
officers  previously  tested  with  the  experimental  battery.  The  exercise  was  staged  at  the 
Officer  Evaluation  Center  established  for  the  purpose  at  Fort  McClellan,  Alabama.  In  1967 
and  1968,  evaluations  of  performance  in  combat  (Vietnam)  and  in  combat-ready  situations 
(Europe,  Korea,  CONUS)  were  obtained. 

Analyses  now  being  completed  are  concerned  oh  tfly  with  means  of  scoring  the  pre¬ 
dictor  instruments.  The  present  Technical  Research  Note  details  the  analysis  of  officer 
responses  and  formulation  of  scoring  scales  for  the  information  tests  of  the  battery. 

The  entire  research  work  unit  is  responsive  to  special  requirements  of  the  Deputy 
Chief  of  Staff  for  Personnel  as  well  as  to  requirements  of  RDT&E  Project  2J062106A722, 
"Selection  and  Behavioral  Evaluation:  Personnel  Measurement,"  FY  1969  Work  Program. 


FACTOR! ALLY  DERIVED  INFORMATION  MEASURES  FOR  DIFFERENTIAL 
PREDICTION  OF  OFFICER  PERFORMANCE 


BRIEF 


Requires  ..t: 

Development  of  scoring  formulas  for  mcr.y  of  ihe  experimental  predictors  of  the 
Differential  Officer  “atieiy  requires  detailed  and  complex  analysis  of  officer  responses. 
These  analyses,  while  time-consuming,  are  an  essential  step  toward  the  end  product- 
psychological  measures  that  are  usefully  discriminative  for  assignment  of  officers  to 
combat,  technical,  and  administrative  duties. 


Procedure: 

Analysis  of  the  information  test  in  the  battery  took  the  unusual  form  of  a  double 
analysis-each  analysis  based  on  half  the  questions-and  a  synthesis  of  the  results.  Two 
equivalent  sets  of  questions  were  formed  from  the  600  information  questions  in  the  battery. 
The  officer  sample  for  both  analyses  consisted  of  900  officers  who  took  the  test  at  entry 
on  active  duty,  100  being  randomly  selected  from  each  of  nine  branches  of  service.  In 
each  analysis,  officer  responses  were  grouped  on  the  basis  of  interrelationships  (factor- 
analyzed)  to  define  relatively  independent  areas  of  information.  Matching  areas  defined  in 
the  two  parallel  studies  were  identified  for  scoring  proses.  Questions  not  belonging  in 
the  matched  areas  wore  assembled  on  the  basis  of  content  into  13  additional  sets. 


Findings: 

Ten  areas  of  information  were  matched  in  the  two  separate  analyses: 


Practical  skills 
Technology  operations 
Math  -  physical  science 
History  -  politics 
Literature  -  arts 


Entertainment  -  culture 
Finance 

Organized  sports 
Intellectual  games 
Biochemistry 


Utilization  of  Findings: 

All  23  scores  formulated  as  a  result  of  the  analyses  will  be  evaluated  as  predictors 
of  officer  performance  as  determined  by  1)  ratings  after  one  year  of  active  duty,  2)  per¬ 
formance  m  a  simulated  combat  exercise  conducted  at  the  Officer  Evaluation  Center,  and 
3)  1967-68  ratings  obtained  in  the  field,  either  in  combat  in  Vietnam  or  in  combat-readv 
situations  (Europe,  Korea,  CONUS) .  The  studies  will  demonstrate  to  what  extent  scores  on 
the  several  information  areas  are  differentially  predictive  of  officer  effectiveness  in 
combat,  technical,  and  administrative  assignments.  Basing  scores  on  a  double  analysis 
should  reduce  the  effect  of  chance  results  in  evaluating  the  prediction  achic.od. 


FACTOR! ALLY  DERIVED  INFORMATION  MEASURES  FOR  DIFFERENTIAL 
PREDICTION  OF  OFFICER  PERFORMANCE 


CONTENTS 


BACKGROUND 

Design  of  Overall  Study 
OBJECTIVES 
METHOD 

Sample  for  Analysis 
Variables 

Analysis  Procedure 


RESULTS 


Identification  of  Factors 
Matching  Odd  and  Even  Factors 
Correlation  among  Factor  Scales 
Independence  among  Factor  Scales 
Selection  > ' f  Items  for  Final  Scoring  Scales 

SUMMARY 

DISTRIBUTION 


DD  corm  1473  (Document  Control  Data  •  R&Oi 


TABLES 


Table 


Page 


1.  Content  categories  represented  in  DOB  iniurmation  tests 

2.  Percent  of  total  variance  accounted  tor  hv  1 '[  factors 
in  each  sample 

3.  Content  categories  represented  in  DOB  information 
factors 

4.  Percentages  of  items  from  content  Ccategories  included 
in  matched  factors  from  odd-  and  even-item  data 

5.  Correlation  between  matched  odd-even  factor  scales 

6.  Correlations  among  factor  scales  ' od 1-even  averaged  1 

7.  Correlations  between  factor  scales  i' odd-even  averaged) 
and  residual  content  scales 


Ten  final  factor  scales 

Estimated  reliabilities  and  intercorrelations  among 
final  factor  scales 


Final  residual 


itont  scales 


F 

14 


r ACTORI ALLY  DERIVED  INFORMATION  MEASURES  FOR  DIFFERENTIAL 
PREDICTION  OF  OFFICER  PERFORMANCE 


BACKGROUND 

The  research  reported  here  is  part  of  a  comprehensive  longitudinal 
program  to  predict  officer  performance  by  psychological  measures  obtained 
at  entry  on  active  duty.  In  1  and  again  in  :  large  samples  of 

officers  took  a"  extensive  battery  of  measures  of  officer  leadership 
pocential.  These  measures  were  designed  to  evaluate  qualities  important 
in  military  leadership  in  any  area--the  "generalist"  concept--and  quali¬ 
ties  relevant  to  performance  in  each  of  three  broad  areas--combat ,  tech¬ 
nical.  and  administrative.  The  I  ••  input  of  4  '  officers,  from  which 

the  present  sample  was  drawn,  took  a  two-dav  battery  of  measures  called 
the  Differential  Officer  Battery  DOb'  at  the  beginning  of  attendance  at 
Branch  Basic  Officer  courses.  About  one  year  later,  their  job  perform¬ 
ance  and  potential  were  evaluated  bv  supervisors  and  colleagues  work)  :;g 
closely  with  them.  Some  six  months  later,  officers  in  a  selected  sample 
were  evaluated  in  a  throe-day  integrated  exorcise  simulating  performance 
of  combat ,  technical,  and  >dmin i st rat i ve  duties  in  a  combat  situation 
staged  at  the  Officer  rlvaUiat  ion  Center  specially  instituted  for  the 
evaluat  ions.  Finally,  in  the  per'od  from  Spring  1  '  to  Spring  !  •<'  . 

those  members  of  the  original  4  -man  sample  who  were  still  on  active 
duty  were  rated  on  job  performance  in  a  combat  theater  Vietnam '  or  in 
combat  -  ready  situations  m  Europe,  Korea,  or  CONUS . 


Design  of  Overall  Study 
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OBJECTIVES 


The  primary  objective  was  to  obtain  relatively  homogeneous  i t  em 
i«  s  t  e i s  foi  assembling  into  scales  to  be  validated  for  all  criteria. 

addition,  t he  comprehensive  data  iftcrde-,  an  .portuni'v  tor  an 
pineal  test  -t  the  usefulness  e»  'act.  :  analysis  of  n  em  inter,  rre- 
itiens  as  a  technique  tor  devel  >ping  homogeneous  sc  -ring  scales.  Since 
io  information  measures  contained  ■  rmii  t  ;r>’«  e-c  hoi  ce  items  covering  .  : 
fferer.t  content  areas,  it  was  pra.  t ;  .  ab!  e  io  u  i  v 


va  s  [' r  .a  .  t 


i  nt  o 


two  equivalent  parts  with  900  items  in  each.  In  this  way,  the  factors 
and  scales  obtained  from  the  two  analyses  could  be  compared  and  the 
stability  of  factor  structure  across  th  two  analyses  could  be  assessed. 
Thus,  a  second  objective  was  to  assess  the  extent  of  factor  congruence 
in  two  samples  of  item  content. 


METHOD 

Sample  for  Analysis 

The  analysis  was  designed  to  reveal  psychological  factors  across  all 
branches  of  service.  Therefore,  the  sample  was  selected  to  afford  ade¬ 
quate  representation  of  all  branches  rather  than  the  proportions  found 
in  the  inpu*-  population.  There  were  nine  branch  basic  courses:  Infantry, 
Armor,  Artillery,  Engineer,  Signal,  Ordnance,  Quartermaster,  Adjutant 
General,  and  Finance.  From  eacn  of  these,  100  cases  were  randomly 
selected  to  compose  the  analysis  sample  of  900.  In  general,  the  first 
three  could  be  considered  to  represent  combat,  the  next  three  technical, 
and  the  last  three  administrci  ve  specialties. 

Variables 

The  DOB  contained  four  information  tests  of  I50  items  each.  The  900 
odd-numbered  items  constituted  the  set  of  variables  f. r  one  analysis,  the 
even-numbered  items  the  set  fo”  the  other  analysis.  The  number  of  items 
in  each  set  belonging  to  each  content  category  s  shown  in  Table  1. 


Analysis  Procedure 

Steps  in  the  analysis  were  as  follows: 

1.  Correct  response  p-values  were  obtained  for  all  items.  Those 
with  extreme  values--less  than  .10  or  greater  than  .90--were  excluded 
from  further  analysis. 

2.  All  retained  items  were  intercorrel ated  ( tetrac.horic  r).  There 
-/ere  290  items  in  each  matrix. 

0.  Each  matrix  was  factored  by  the  principal  axes  method,  using  the 
highest  off-diagonal  entry  as  the  communal ity  estimate. 

4.  After  inspection  of  the  eigen  values,  the  first  17  factors  were 
rotated  to  simple  structure  by  the  varimax  method. 

9.  Factor  clusters  were  assembled,  each  item  being  placed  in  the 
cluster  for  which  ii  showed  th"  highest  loading. 

f .  The  clusters  were  refined  to  provide  scales  of  20  items  where 
possible.  items  with  higher  loadings  in  a  given  factor  and  negligible 
loadings  on  all  other  factors  were  given  preference  in  se’  ction  for  a 
scale. 


Table  1 


CONTENT  CATEGORIES  REPRESENTED  IN  DOB  INFORMATION  TESTS 


_ Number  of  Items _ 

Category  Odd  Even  Total 


Combat  Tactics 

25 

25 

50 

Organized  Sports 

14 

29 

Nature  Sports 

7 

Q 

V..' 

15 

Farm  Facts 

9 

18 

Biology-Medicine 

1  "I 

9 

19 

Psychology- Psychiatry 

9 

10 

19 

Technical  Service  Hardware 

25 

25 

50 

Mechanical  Information 

13 

12 

25 

Fhysics 

5 

9 

17 

Chemistry 

8 

8 

16 

History  and  Philosophy  of  Science 

8 

7 

15 

Mathematics 

13 

14 

27 

Supply,  Warehousing 

25 

25 

50 

Games 

8 

8 

16 

Art 

q 

9 

18 

Music 

8 

O 

O 

16 

Entertainment 

9 

9 

18 

Literature 

16 

16 

32 

Finance 

28 

27 

55 

World  Affairs,  Politics 

15 

16 

31 

Socioeconomic  Facts 

11 

11 

22 

Quantitative  Miscellany 

8 

8 

16 

Qualitative  Miscellany 

13 

13 

26 

RESULTS 


Identification  of  Factors 

The  proportions  of  total  variance  included  in  each  of  the.  17  rotated 
factors  in  each  analysis  are  shown  in  Table  2.  It  will  be  remembered 
that  the  analysis  was  based  on  it:  .1  intercorrelations,  which  tend  to  be 
moderate  in  size  because  of  modest  single-item  reliability.  Not  every 
factor  provided  enough  items  with  highest  loadings  to  yield  a  usable 
scaled  Furthermore,  clusters  of  items  were  identified  in  which  there 
were  substantial  loadings  on  two  factors.  Even  though  such  clusters 
could  not  provide  relatively  independent  scales,  they  promised  reasonable 
homogeneity,  and  the  segregation  of  their  items  from  the  clusters  with 
unique  loadings  on  one  or  the  other  of  the  two  factors  improved  the  homo¬ 
geneity  of  scales  based  on  the  unique  clusters.  The  result  was  the  iden¬ 
tification  of  14  usable  factor  scales  in  each  analysis.  Analysis  of  the 
odd-numbered  items  yielded  13  reasonably  unique  one-factor  scales  and 
one  scale  of  items  loaded  on  factors  I  and  IV.  Analysis  of  even-numbered 
items  yielded  12  cne-factor  scales  plus  factor  I-IV  and  factor  II-V 
combinations . 


Table  2 


FERCENT  OF  TOTAL  VARIANCE  ACCOUNTED  FOR  BY 
1"  FACTORS  IN  EACH  SAMPLE 


Percent 

of  Variance 

Factor 

Odd 

Even 

I 

3.66 

4.23 

II 

2.46 

2.97 

III 

2.72 

2.65 

IV 

4.55 

2.75 

V 

1.60 

1.86 

VI 

I.98 

1.77 

VII 

1.49 

0.97 

VIII 

0.91 

1.00 

IX 

1.01 

1.05 

X 

0.90 

0.96 

XI 

0.84 

0.92 

XII 

O.85 

0.85 

XIII 

0.93 

0.88 

XIV 

O.85 

0.87 

XV 

1.65 

0.84 

XVI 

0.91 

0.82 

XVII 

0.91 

0.81 

Total 

28.22 

ro 

CJT 

ro 

i-'  Factor  VII  in  the  odd  set  had  only  5  items,  factor  VII  in  the  even  set 
only  3.  These  factors  were  retained  because  of  the  very  high  loadings 
(odd,  .64  to  .77;  even,  .71  to  .  n7>). 
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Matching  Odd  and  Even  Factors 


Factors  derived  from  analysis  of  the  odd-  and  of  the  even-numbered 
information  items  were  compared  on  the  basis  of  number  of  items  from 
each  content  category*  Table  J  presents  the  tabulation  of  number  of 
items  in  each  content  category  for  the  matched  factors.  Thus,  odd 
factor  I  (I  )  has  20  items  across  six  categories,  and  matched  even 

factor  IV  ( IV  )  has  20  items  across  five  of  these  same  categories.  It 

was  clearly  revealed  that  odd  factor  I  matched  even  factor  IV,  that  odd 
factor  IV  matched  even  factor  I,  and  that  the  I-IV  combination  factors 
were  matched.  In  addition,  factors  II,  III,  and  V  through  VIII  matched 
their  respective  number,  in  the  other  set,  and  odd  factor  XV  matched  the 
even  II-V  combination.  Partial  matching  was  achieved  between  odd  XIV 
and  even  IX,  and  between  odd  XIII  and  even  XIV.  Only  two  factors  from 
each  set  failed  to  match  by  this  comparison. 

Table  4  shows  the  percentage  of  items  from  each  content  category  in 
the  matched  factors  and  affords  a  ready  basis  for  interpretation  of  the 
factor  scales.  The  table  also  suggests  to  some  extent  the  content  rela¬ 
tionships  among  factors  1  and  IV  and  the  combination  scale,  and  among 
factors  II  and  V  and  the  combination  scale.  The  latter  scale  emerged  as 
a  separate  factor  XV  in  the  odd  set.  The  broad  interpretations  of  the 
scales  are  as  follows: 


Odd 

Even 

I 

IV 

Practical  '-nowledge,  rural-mechanical 

I-IV 

i-IV 

Mechanical  and  physical  science  knowledge 

IV 

I 

Physical  sciences  and  mathematics 

II 

II 

Humanities,  social  science 

XV 

II-V 

Entertainment,  arts 

V 

V 

Aesthetics 

III 

III 

Finance 

VI 

VI 

Organized  sports 

VII 

VII 

Intellectual  games 

VIII 

VIII 

Biology,  chemistry 

XIV 

IX 

Military  tactics,  technical  services 

XIII 

XIV 

Supply 
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Table  4 


PERCENTAGES  OF  ITEMS  FROM  CONTENT  CATEGORIES  INCLUDED  IN 
MATCHED  FACTORS  FROM  ODD-  AND  EVEN- ITEM  DATA 


Content  Categories 

Odd  Factor 

Even 

Factors 

I 

IV  I- 

-IV 

I 

Nature  sports,  farm  facts 

55* 

40 

10 

0 

Tech  sve  hardwa  e,  mech  information 

55 

50 

35 

10 

I- IV 

Tech  sve  hardware,  mech  information 

55 

50 

55 

10 

Physics,  Chemistry 

£5 

0 

25 

35 

IV 

Physics,  Chemistry 

40 

0 

15 

55 

Mathematics 

50 

0 

0 

15 

ii 

II 

V 

II-V 

Art,  Literature 

55 

15 

40 

25 

Politics,  Socioeconomic 

50 

15 

5 

0 

V 

Art,  Music 

55 

25 

20 

17 

Literature 

50 

5 

55 

25 

XV 

Music,  Entertainment 

55 

25 

10 

42 

Literature 

10 

5 

25 

15 

hi 

III 

Finance 

55 

25 

VI 

VI 

Organized  Sport 

100 

100 

VII 

VII 

Games 

100 

100 

VIII 

VIII 

Biology-Med,  Chemistry 

62 

JO 

XIV 

IX 

Tactics,  Tech  sve  hardware 

60 

60 

XIII 

XIV 

Supply  and  Warehousing 

45 

52 

8Undortin«d  values  (percentages)  are  for  matched  factors. 


Correlation  among  Factor  Scales 

A  more  precise  test  of  whether  the  same  factors  are  found  in  the  two 
analyses  is  of  course  the  correlation  between  matched  factors  based  on 
subjects'  scores  on  the  two  scales.  The  correlation  coefficients,  provid¬ 
ing  estimates  c  reliability,  are  shown  in  Table  "5.  These  coefficients 
between  independent ly  determined  scales  would  be  expected  to  be  lower 
than  reliability  estimates  based  on  odd-even  assemblies  in  a  consecutive 

-  7  - 
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sequence.  To  provide  comparable  estimates,  the  reliability  per  unit 
length  (that  is,  for  a  single  item)  is  presented,  as  well  as  the  reli¬ 
ability  estimate  for  the  combined  pair  of  scales.  It  is  evident  that 
most  correlation  coefficients  for  the  combined  scales  are  in  the  accept¬ 
able  range  of  reliability  for  tests  of  the  given  length. 


Table  5 


CORRELATION  BETWEEN  MATCHED  ODD-EVEN  FACTOR  SCALES 


Odd 

Factor 

No .  of 

Items 

Even 

Factor 

No .  of 
Items 

Correlation 

Coefficients* 

Rel iabil lty 

Single  Itenf  Scale* 

I 

20 

IV 

20 

660 

088 

79 

I-.  7 

20 

I- IV 

15 

757 

151 

86 

IV 

20 

I 

20 

795 

162 

89 

II 

20 

II 

20 

668 

001 

80 

V 

20 

V 

20 

506 

049 

67 

XV 

20 

II-V 

12 

477 

054 

66 

III 

2u 

III 

20 

782 

152 

88 

VI 

12 

VI 

11 

624 

126 

76 

VII 

cr. 

J 

VII 

3 

215 

064 

37 

VIII 

8 

VIII 

10 

426 

074 

60 

XIV 

10 

IX 

IS 

28? 

030 

44 

XIII 

12 

XIV 

8 

152 

018 

26 

Matched  Odd 

-Even  Residual  Content 

Scales 

Tactics 

15 

Tactics 

18 

106 

016 

00 

Supply 

15 

Suppl y 

14 

os 

OS'2, 

00 

flO©C,mttl  points  omitted. 


All  items  not  included  in  the  factor  scales  were  assembled  into 
residual  content  scales,  all  items  from  one  ■content,  category  being  placeu 
in  a  single  scale.  There  were  enough  residual  items  in  two  categories-- 
Tactics  and  Supply--. 0  provide  both  odd  and  even  scales.  Correlation 
within  these  pairs  is  shown  for  comparison  with  correlation  between 
matched  factor  scales.  It  is  evident  that  the  unit  reliability  coeffi¬ 
cients  for  these  residual  content  scales  are  equivalent  to  those  for  the 
partial ly  matched  factor  scales--the  last  two  listed.  From  the  data  in 
Table  5,  the  decision  was  made  to  use  the  first  ten  factor  scales  for 
scor ing  and  to  relegate  the  items  of  the  last  two  to  residual  content 
scales,  obtaining  in  all  ly  scales.  Hereafter,  factors  XIV  ,  IX  ,  XIII  , 

and  XIV  are  treated  as  unmatched  factors.  o  e  o 

e 


I  ^dependence  among  Factor  Scales 


Table  6  presents  the  estimated  correlation  among  the  ten  accepted 
scales  from  each  analysis,  obtained  by  averaging  the  correlation  coeffi¬ 
cients  of  each  pair  member  with  a  given  pair.  ( Note  that  these  are  not 
estimates  of  correlation  among  the  full-length  combined  scales.)  Except 
for  the  expected  correlation  between  the  scales  based  on  items  with 
loadings  on  two  factors--the  I-IV  and  TI-V  scales--only  the  factor  VIII 
scales  show  appreciable  correlation  with  others--the  I-IV  set  and  factor 
scale  II.  Correlation  with  the  unmatched  factors  was  also  low,  except 
for  XIV^  and  IX^,  which  correlated  moderately  with  the  same  four  scales 

as  factor  VIII. 

Table  7  presents  correlation  coefficients  between  the  ten  selected 
scales  and  all  residual  content  scales.  All  but  a  few  of  the  moderate- 
size  coefficients  are  found  between  content  scales  and  factor  scales 
with  five  or  more  items  from  the  same  content  category. 


Table  6 

CORRELATIONS*  AMONG  FACTOR  SCALES  (ODD-EVEN  AVERAGED) 


Factor  Scales'* 


Odd -I 

’-IV 

IV 

II 

XV  V 

III 

VI 

VII 

VIII 

Odd 

Even 

Even- IV 

I-IV 

I 

II 

II-V  V 

III 

VI 

VII 

VIII 

Matched  Factors 


I 

IV 

66 

I-IV 

IV 

I-IV 

I 

68 

-*-*■ 

ow 

C. 

76' 

61 

80 

II 

II 

16 

20 

/*v» 

CL  , 

67 

XV 

II-V 

IX 

21 

18 

60 

48 

V 

V 

11 

ix 

0-1 

18 

61 

III 

III 

-01 

-0-1 

-0-1 

07 

12 

/  0 

VI 

VI 

-06 

-11 

08 

2L 

2X 

12 

f 

6-2 

VII 

VII 

1 x 

1-1 

21 

16 

IX 

00 

1 7  2.  • 

VIII 

VIII 

•1,' 

X  Vi 

;  X  } 

n 

-04 

04  16  47 

Unmatched  Factors 

XIV 

■  '  1. 

,  r 

OX 

’X") 

0  ^ 

06 

ny 

06  l7  lf- 

IX 

7^ 

46 

77 

16 

V- 

or 

07  04  27 

XIII 

11 

■  i 

07 

y  x 

if 

12 

...  4 

<07  2:  06 

XIV 

IV 

j 

04 

11 

^  .7 

1  1 

^ 

08  02  06 

IX 

1  -  - 

i.  ; 

] 

:  V'- 

1 

4.  . 

t  4 

1’ 

J.  '  •  )  v''  ) 

XIII 

21 

24 

lS 

10 

1* 

-01 

yy 

'•••  11  IX 

XVII 

i-i 

17 

70 

-\  . 

1  r 

y; 

06  ox 

X 

07 

1  X 

11 

1 1 

l; 

•  1 

1  17 

0  1  ■ '  6  0-  1 

* D @c  1  ml i  point*  ot'ittod 

t>aa*d  on  i;«m*  with 

loading* 

on  two  facto'*  <:«.g 

..  MV. 

H-\) 

b*  e*p*K-t*d  to  < 

cotf*i4t*  *ubat»nt-«Mv  wi th 

haaad  on  i|i*m*  with 

loBditiga 

uniQufily 

on  on*  of 

the  two 

fflrtpf*. 

Und«f  ' 

1  n<*d  ro*ff 

tCmntl  at*  fof  a./Ch  rpiat-on- 

•  hip». 
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CGI. RELATIONS*  BETWEEN  FACTOR  SCALES  ( ODD- EVEN  4VFRAOFnl  AND  RESIDUAL  CONTENT  SCALES 


Residual  Content  Scales 

Odd  -  I 

Even- IV 

I -IV 
I-IV 

IV 

I 

Factor  Scales11 

11  XV  V  III 

II  II-V  V  III 

VI 

VI 

VII 

VII 

VIII 

VIII 

Tactics  (0) 

27= 

27 

21 

20 

0J  ;v- 

0  * 

P‘2; 

11 

12 

Tactics  (E) 

17 

1  1 

04  7  ) 

77 

'4 

17’ 

10 

Life  Science 

V' 

V', 

22 

15 

17  17 

0;-' 

01 

c  > 

2u 

Psychology 

In 

15 

10 

21 

16  27 

»  ip 

10 

10 

Technical  Service 

4^ 

no 

01 

17 

14  10 

-.'4 

-01 

11 

75 

Ma enema'  ics-  Pny3ics 

V) 

57 

ly 

li  17 

Oil 

or 

14 

P‘2, 

History  and  Philosophy  of  Science 

It' 

27 

10 

i,  m 

,\f 

11 

1  ■ 

Games 

0  l 

0t; 

00 

p 

"4  77 

^  ) 

— 1 

04 

Supply  (O'! 

">"7 

.'0 

17 

2  1 

1 7 

0 

00 

V-'. 

Supply  t  E) 

■'c, 

74 

1  ’A 

^ ) 

1 1  77 

7  1 

17 

1  ] 

Art -Mu sic- Entertainment 

1  ) 

70 

U 

M_ 

— -  — 

! 

17 

1  I 

14 

Literature 

:M 

7- 

71 

7  • 

— 

1  * 

1  1 

;  j 

Finance 

7- 

1  ' 

) 

]  - 

]  «' 

.'■/ 

1  / 

Po 1  i  t  i  c  s 

;  07 

]  p 

■ 

— 

1  '■ 

1  ] 

Soc i occonomi c 

1  - 

-  ■» 

1.  •  « 

’  - 

Quantitative  Miscellany 

•1  • 

0 

1  ) 

•  ’ 

1 4 

Qualitative  Miscellany 

^  , 

■  '1 

* 

’ 

aO©Ctrrwil  [joint*  onvUwl. 

!m#d  v»lu«*  W®  correlations  actant  SvlrtiOJi  llrtd  n  '• 1 

seal***  cfcm*'f'g 

*>  (V  fTK’ff*  t 

twns  :  t  kwv. 

irvitfm  t . 

Selection  of  Items  for  Final  Scoring  Scales 

Based  on  the  above  findings,  it  was  decided  to  assemble  ten  factor- 
based  cales  by  combining  matched  odd-even  scales.  To  provide  greater 
length  for  five  of  the  scales,  item  factor  loadings  and  specific  content 
were  reviewed,  and  seven  scales  of  40  items,  two  scales  of  25  items,  and 
one  scale  of  10  items  were  assembled.  The  resultant  scales  are  listed 
in  Table  8. 

The  short  Intellectual  Games  scale  offers  a  note  of  ir^eresc.  Ail 
five  items  from  odd  factor  VII  were  about  chess,  while  all  three  from 
even  factor  VII  were  about  bridge.  This  accidental  segregation  led  to 
low  loadings  on  factor  VII  for  the  one  odd  item  on  bridge  and  the  one 
even  iter  on  chess.  Adding  these  two  items  to  the  combined  scale  may 
well  have  y:®lded  a  more  reliable  total  scale  score  than  would  be  ex¬ 
pected  froir,  the  coefficient  of  .22  between  the  two  short  factor  v'll 
scales . 

Table  ">  gives  estimated  reliability  and  intercorrelation  of  the 
final  factor-based  scales.  Despite  particular  findings  such  as  that  on 
the  Games  scale,  these  estimates  are  based  on  the  assumption  that  the 
unit  reliability  coefficients  and  intercorrelations  for  all  scales 
would  be  the  same  as  those  shown  in  Tables  5  and  c. 

Finally,  Table  1,'  shows  the  selected  residual  content  scales. 

Where  there  were  too  few  items  left  in  a  given  category,  items  in  that 
category  were  'ombined  witn  those  of  a  category  to  which  they  appeared 
to  be  related  on  the  buns  of  overall  factor  results  and  logic. 


TEN  F  f  NA I.  FACTOR  SCALES 


TabLe  > 


ESTIMATED  RELIABILITIES  AND  INTERCG.TRELATIONS 
AMONG  FINAL  FACTOR  SCALES* 


Final  Factor  Scales 


PS 

Practical  Skills  ;  PS; 

TO 

12 

Technology  Operations  'TO^ 

t  ■  } 

HP 

Math  and  Physical  Science 

MPl 

r  ’ "« 

"-'i 

HP 

History,  Politics-Culture 

HP' 

1 

7  4 

7  1 

“l 

LA 

Licerature  and  Arts  LA' 

1  4 

i  ‘t 

1  o; 

EC 

Entertainment-Culture  EC ' 

7  4-'  ;i 

Finance  FT' 

-  ''1 

-IT 

T-  14  v 

Organized  Sports  OS' 

'  s 

mtel lectual  Games  IC' 

• 

BC  ' 


Bi ochemi  s t  ry 


Table  10 


FINAL  RESIDUAL  CONTENT  SCALES 


Items 

Seale 

Content 

Number 

Total 

Warfare 

Tactics 

43 

43 

Outdoors 

Organized  Sports 

Nature  Sports 

4 

12 

Farm  Facts 

5 

Life  Science 

Biomedical 

4 

16 

Psychology 

12 

Technology 

Technical  Service 

27 

32 

Mechanical  Information 

5 

Math-Science 

Physics 

3 

Chemistry 

1 

11 

Mathematics 

7 

History- Literature 

History  and  Philosophy  of 

Science 

7 

12 

Literature 

5 

Supply 

Supply 

44 

44 

Intell.  Entertainment 

Games 

6 

Art 

5 

17 

Music 

3 

Entertainment 

3 

Finance 

Finance 

16 

16 

Political  Science 

Politics 

12 

12 

Economic -Social 

Socioeconomic 

13 

13 

Quantitative  Misc. 

Quantitative  Miscellany 

14 

14 

Qualitative  Misc. 

Qualitative  Miscellany 

10 

18 

Total 

260 

-  14  - 
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SUMMARY 


To  obtain  relatively  homogeneous  and  mutually  independent  scales  for 
scoring  the  600  items  of  the  Differential  Officer  Battery  information 
tests,  two  factor  analyses,  one  using  odd  items,  the  other  even,  were 
performed  on  matrices  of  item  intercorrelations.  Seventeen  principal 
axes  factors  in  each  analysis  were  rotated  to  simple  structure  by  the 
varimax  method.  From  each  17,  14  usable  factor-based  scales  were  derived 
Matching  of  these  scales  by  content  categories  of  the  items  included  and 
by  scale  intercorrelations  demonstrated  that  the  scales  from  each  analysi 
matched  well  with  scales  from  the  other  analysis.  The  paired  scales  were 
then  assembled  and  some  were  augmented  slightly  to  yield  ten  final  factor 
based  scales  embracing  a  total  of  340  items.  The  remaining  260  items 
were  assembled  into  13  residual  content  scales. 

Factor  solutions  based  on  the  two  samplings  of  related  items  showed 
high  congruence  in  major  dimensions.  The  ten  factor  scales  were  tenta¬ 
tively  interpreted.  All  23  final  scales--10  factor  and  13  residual  con¬ 
tent  scales--are  to  be  validated  for  officer  performance  criteria  to 
determine  whether  they  are  differentially  predictive  of  effectiveness  in 
combat,  technical,  and  administrative  activities. 
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n.  Technical  Research  Note  203  reports  orr'research  completed  in  the  initial  phase 

of  a  comprehensive  longitudinal  program  to  predict  officer  performance  in  combat,  tech¬ 
nical,  and  administrative  duties  by  psychological  measures  obtained  at  entry  on  active 
duty.  Sin  I958  and  again  in  1962,  an  extensive  battery  of  measures  of  officer  leadership 
potential  was  administered  to  a  large  sample  of  officers.  The  1962  input  of  4000  offi¬ 
cers,  source  of  the  sample  used  in  the  present  study,  took  the  Differential  Officer  Bat- 
try  (DOB)  in  a  two-day  session  at  the  beginning  of  attendance  at  Branch  basic  Officer 
courses.  In  a  one-year  follow-up,  job  performance  and  potential  of  these  men  were  evalu¬ 
ated  by  supervis  rs  and  peers  working  closely  with  them.  Some  six  months  later,  a  se¬ 
lected  900-officer  sample  was  evaluated  in  a  three-day  integrated  simulation  exercise 
staged  at  the  Officer  Evaluation  Center  (OEC).  Lastly,  in  the  period  from  Spring  I967  tc 
Spring  X908,  ratings  on  job  performance  in  a  combat  theatre  (Vietnam)  or  in  combat-ready 
situations  in  Europe,  Korea,  or  CONUS  were  obtained  on  those  members  of  the  1962  input 
still  on  active  duty. 

Analysis  being  completed  is  concerned  chiefly  with  means  of  scoring  the  predictor 
instruments.  The  present  publication  details  the.  analysis  of  officer  responses  and  for¬ 
mulation  of  scoring  scales  for  the  information  tests  of  the  DOB.  For  the  information 
content  of  the  test  battery,  a  double  analysis  was  performed  and  the  results  synthesizei 
Two  equivalent  sets  of  questions  were  formed  from  responses  of  a  900-officer  sample  to 
600  questions.  The  300  items  in  each  set  were  analyzed.  Ten  matching  factors  were  iden¬ 
tified  by  the  two  parallel  studies  and  13  additional  sets  were  assembled  from  the  re¬ 
maining  questions- -23  scoring  scales  in  all--to  be.  validated  as  predictors  of  officer 
performance .basing  scores  on  the  double  analysis  should  reduce  the  effect  of  chance  in 
evaluating  the  predictive  effectiveness  of  the  scores.  . 
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